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(54) Protecting images with an image watermark 



(57) A robust means of watermarking a digitized im- 
age with a highly random sequence of pixel brightness 
multipliers is presented. The random sequence is 
formed from 1 robust- watermarking-parameters' select- 
ed and known only by the marker and/or the marking 
entity. A watermarking plane is generated which has an 
element array with one-to-one element correspondence 
to the pixels of the digitized image being marked. Each 
element of the watermarking plane is assigned a ran- 
dom value dependent upon a robust random sequence 
and a specified brightness modulation strength. The so 
generated watermarking plane is imparted onto the dig- 
itized image by multiplying the brightness value or val- 



ues of each pixel by its corresponding element value in 
the watermarking plane. The resulting modified bright- 
ness values impart the random and relatively invisible 
watermark onto the digitized image. Brightness altera- 
tion is the essence of watermark imparting. Detection of 
an imparted watermark requires knowing the water- 
marking plane with which the watermark was imparted. 
Regeneration of the watermarking plane requires 
knowledge of the robust-marking-parameters used in its 
formulation. This is generally only known to the marker 
and/or marking entity. Once regenerated the water- 
marking plane is used together with a verifying image 
located in a Visualized to demonstrate the existence of 
the watermark. 
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Description 

FIELD OF THE INVENTION 

This application relates to the field of digital imag- 
ing. It is more specifically concerned with the insertion 
and detection of an identifying mark on a work-piece. 

BACKGROUND OF THE INVENTION 

It is a constant endeavour to find improved tech- 
niques of placing a visible or invisible identifying mark 
on an image. This is generally useful to establish own- 
ership, origin and authenticity, and also to discourage 
those who might wish to purloin or misappropriate the 
work. Identifying marks are also useful to give evidence 
of unauthorized alteration or disclosure. 

Visible marks are herein classified as being either 
visible robust or visible fragile. A mark is classified as 
visible robust if it can be seen by the unaided eye and 
cannot be easily removed from the work-piece, if at all, 
without leaving telltale evidence. It is classified as visible 
fragile if the mark itself is visibly altered by an attempt 
to alter the work-piece or its wrapper. 

Invisible marks are herein classified relative to the 
appearance of that mark to a human being with normal 
visual acuity. A mark on an image is classified as having 
an invisibility classification level of undetectably invisi- 
ble if. when the image without the marking is displayed 
together with an image copy with the marking, the hu- 
man being is equally likely to select either of these cop- 
ies. An undetectably invisible mark is below or at the 
human being's just noticeable difference. A mark on an 
image is classified as having an invisibility classification 
level of sublimina fly invisible if the mark is not distracting 
to the human being, although it is above the human be- 
ing's just noticeable difference. An image marking is 
classified as being marginally invisible if it does not 
cause the marked image to lose its usefulness or value 
because of the mark. An image marking is classified as 
being poorly invisible if the marking causes a reduction 
in the image's usefulness and/or value. 

Presently, both visible and invisible markings of 
hardcopy documents are used as a generally depend- 
able method of establishing ownership and authenticity. 
These time-tested methods are also useful for marking 
a "softcopy" digitized image, also referred to herein as 
a digital image or image. A digital image is an abstrac- 
tion of a physical image that has been scanned and 
stored in a computer's memory as rectangular arrays of 
numbers corresponding to that image's (one or more) 
colour planes. Each array element corresponding to a 
very small area of the physical image is called a picture 
element, or pixel. The numeric value associated with 
each pixel for a monochrome image represents the 
magnitude of its average brightness on its single colour 
(black and white) plane. For a colour image, each pixel 
has values associated and representing the magnitudes 



2 

or average brightnesses of its tristimulus colour compo- 
nents representing its three colour planes. Other image 
representations have more than three colour compo- 
nents for each pixel. A different value is associated with 
5 each different one of the image's colour planes. 

In what follows, whenever reference is made to col- 
our planes it is understood to include any number of col- 
our planes used by a particular image's digitizing tech- 
nique to define the pixel's colour characteristics. This 
to includes the case when there is only a single plane de- 
fining a monochromatic image. 

A digitalized image is recognizable as an image to 
a viewer only when the individual pixels are displayed 
as dots of white or coloured light on a display or as dots 
15 of black or coloured inks or dyes on a hardcopy. Pixels 
are normally spaced so closely as to be un resolvable by 
a human visual system. This results in the fusion of 
neighbouring pixels by the human visual system into a 
representation of the original physical image. Image fu- 
20 sion by the human visual system makes invisible mark- 
ing, or relatively invisible marking, of images possible. 
This property is fully exploited by the methods described 
here to both impart upon a digitized image an invisible 
watermark to a desired invisibility classification, and to 
zs subsequently demonstrate its existence. The imparting 
and demonstrated detection of a robust invisible mark- 
ing on digital images, herein called invisible watermark- 
ing, are a primary aspect of the present invention. 

30 PROPERTIES OF A ROBUST INVISIBLE 
WATERMARK 

A proper invisible watermarking technique that im- 
parts an invisible watermark upon a proprietary digitized 

35 image should satisfy several properties. The imparted 
watermark should appear to be invisible to any person 
having normal or corrected visual accommodation to a 
desired invisibility classification level. Clearly, the de- 
gree of marking is a dichotomy. A balance has to be 

40 struck between protecting the image from unauthorized 
uses and not having the watermark unpleasantly alter 
the appearance of the image. This generally means that 
a recognizable pattern should not appear in the marked 
image when the watermark is applied to a uniform colour 

45 plane. This requirement discourages marking the image 
by varying the hue of its pixels, since the human visual 
system is significantly more sensitive to alterations in 
hue than in brightness. The requirement can be satisfied 
by a technique based on varying pixel brightness imple- 

50 mented in a proper way. A technique based on varying 
pixel brightness also allows the same marking tech- 
nique applied to colour images to be equally applicable 
to monochrome images. 

Another property of a proper invisible watermarking 

55 technique is that it should have a detection scheme such 
that the probability of a false-positive detection is van- 
ishingly small. For purposes of the present invention, the 
probability of detection of a watermark in an image when 
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one does not exist should be less than one in a million. 
There is generally little difficulty satisfying this require- 
ment when the technique is statistically based. 

Still another property of a proper watermarking 
technique is that it should be possible to vary the degree 
of marking applied to an image. In this way, the water- 
mark can be made as detectable as necessary by the 
particular application. This property is important in high- 
ly textured images where it is often necessary to in- 
crease the intensity of the mark to increase its likelihood 
of detection. This is in contradistinction with images that 
have low contrast in which it is advantageous to reduce 
the marking intensity to lessen undesirable visible arti- 
facts of the watermark itself. 

It is also highly desirable that when detected the 
demonstrated existence of the watermark should be 
translatable to a recognizable visual image having rela- 
tively bold features with a high contrast ratio. Features 
of a demonstrated visual image that are not relatively 
bold may otherwise be difficull to show if the watermark 
has been attacked in attempts to defeat its protection. 

Finally, the imparted watermark should be robust in 
that it should be very difficult to be removed or rendered 
undetectable. It should survive such image manipula- 
tions that in themselves do not damage the image be- 
yond usability. This includes, but is not limited to, JPEG 
"lossy" compression, image rotation, linear or nonlinear 
resizing, brightening, sharpening, "despeckling," pixel 
editing, and the superposition of a correlated or uncor- 
rected noise field upon the image. Attempts to defeat 
or remove the watermark should be generally more la- 
borious and costly than purchasing rights to use the im- 
age. If the image is of rare value., it is desirable that the 
watermark be so difficult to remove that telltale traces 
of it can almost always be recovered. 

SUMMARY OF THE INVENTION 

An aspect of the present invention is to provide a 
method for imparting a watermark onto a digitized image 
comprising the steps of providing the digitized image, 
and multiplying the brightness data associated with at 
least one of the image pixels by a predetermined bright- 
ness multiplying factor. The image includes a plurality 
of pixels, wherein each of the pixels includes brightness 
data that represents one brightness value if the image 
is monochrome, or a plurality of brightness data values 
if the image has multiple colours. In an embodiment the 
brightness multiplying factor ranges from 0.9 to 1 . 1 . The 
brightness multiplying factor has a relationship with a 
number taken from a random number sequence and the 
relationship is a linear remapping to provide a desired 
modulation strength. 

In an embodiment, each of the pixels has a row and 
a column location in an array representing the digitized 
image, and the brightness multiplying factor employs a 
different sequential combination of numbers from a ro- 
bust random number sequence in sequential corre- 



spondence to the row and column location. 

Another aspect of the present invention is to provide 
a method for generating a watermarked image wherein 
a watermark is imparted onto a digitized image having 
5 a plurality of original elements having original bright- 
nesses. The method includes the step of providing a dig- 
itized watermarking plane comprising a plurality of wa- 
termarking elements, having a watermark brightness 
multiplying factor and having one-to-one correspond- 
10 ence with the original elements. It also includes the step 
of producing a watermarked image by multiplying the 
original brightness of each of the original elements by 
the brightness multiplying factor of a corresponding one 
of the watermark elements wherein the watermark is in- 
1 $ visible. In an embodiment, the original image forms an 
original plane and the watermarking image forms a wa- 
termarking plane being smaller than the original plane, 
the method further includes the step of extending the 
watermarking plane by tiling such that the watermarking 
plane covers the original plane and/or further comprises 
the step of truncating the watermarking plane such that 
the watermarking plane covers the original plane, upon 
determining that the watermarking plane extends be- 
yond the original plane. 

Another aspect of the present invention is to provide 
a method for forming a watermarking plane including a 
plurality of elements each having a multiplying value. 
The method comprises the steps of: generating a secure 
random sequence of integers having a first plurality of 
bits; linearly remapping the random sequence to form a 
remapped sequence of brightness multiplying factors to 
provide a desired modulation strength; computing a dis- 
crete Fourier transform of the remapped sequence to 
form a Fourier sequence having frequency coordinates; 
expanding the frequency coordinates to form an ex- 
panded sequence: and computing an inverse Fourier 
transform of the expanded sequence to obtain a water- 
marking sequence of values. 

An embodiment further includes one or more or the 
following: the step of expanding is accomplished by ze- 
ro-padding; the method further comprises a step of em- 
ploying the watermarking sequence to provide the mul- 
tiplying value for each of the elements; the method fur- 
ther comprises the steps of hardclipping the watermark- 
ing sequence to form a hardclipped sequence having 
sequence members, and utilizing a different one of the 
sequence members to provide the multiplying value for 
each of the elements; the method further comprises the 
steps of adjusting the watermarking sequence to form 
a normalized sequence of values having a mean and a 
median equal to the difference between unity and the 
modulation strength, and having a maximum of unity, 
and employing the normalized sequence to provide the 
multiplying value for each of the elements; the method 
further comprises the steps of providing an unmarked 
original image having a plurality of original pixels, each 
of the pixels having at least one brightness magnitude, 
wherein a first number of the original pixels is greater 
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than a second number of the plurality of elements, ex- 
panding the watermarking plane by tiling to cover the 
unmarked original image such that one of each of the 
pixels has one corresponding element from the ele- 
ments; and multiplying the at least one brightness mag- 
nitude of each of the pixels by the multiplying value of 
the corresponding element. 

Still another aspect of the present invention is to 
provide a method for detecting a watermark in a marked 
image. The marked image is marked by a watermarking 
plane which has a plurality of watermarking elements. 
Each of the image pixels has at least one brightness val- 
ue and each of the watermarking elements has a bright- 
ness multiplying factor. The method employs a selector 
and a visualizer and at least one counter to store the 
comparison data resulting from comparisons for each of 
a plurality of selector elements and positions, of the sta- 
tistical brightness of image pixels and watermarking 
plane elements with the statistical brightness of neigh- 
bouring elements /pixels. The method further comprises 
the step of displaying a visualizer coincidence image 
such that a user can make a determination as to whether 
the pattern encoded by the visualizer pixels is recogniz- 
able and the watermark is detected. 

BRIEF DESCRIPTION OF THE DRAWINGS 

An embodiment of the present invention will now be 
described, by way of example only, and with reference 
to the following figures in which, 

FIG. 1 shows a block diagram of an image capture 
and distribution system suitable for use in accordance 
with an embodiment of the present invention. 

FIG. 2 shows an embodiment for forming a water- 
marking plane in accordance with the present invention. 

FIG. 3 shows an embodiment for the steps of wa- 
termark imparting. 

FIG. 4 shows an overview of the steps for image 
alignment. 

FIG. 5 shows the steps for a coarse alignment of a 
marked image with a correlation reference plane. 

FIG. 6 shows the steps for a fine alignment of a 
marked image with a correlation reference plane. 

FIG. 7 shows the steps for finding a watermark in a 
marked image. 

FIG. 8 shows a random positioning of the selector 
array over the watermarking plane and the image 
planes. 

FIG. 9 shows a typical visualizer pattern. 

FIG. 10 shows a method of verification of the pres- 
ence of the watermark. 

FIG. 11 shows a detection resulting from the visu- 
alizer of Figure 9 for a watermarking made at a modu- 
lation strength of 1%. 

FIG. 12 shows a detection resulting from the visu- 
alizer of Figure 9 for a watermarking made at a modu- 
lation strength of 2%. 

FIG. 13 shows a detection resulting from the visu- 
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alizer of Figure 9 for a watermarking made at a modu- 
lation strength of 4%. 

FIG. 1 4 shows a detection resulting when the image 
has no watermark. 
5 FIG. 15 shows the steps for an alternate method of 

finding a watermark in a marked image. 

The present embodiment provides a robust means 
of watermarking a digitized image with a highly random 
sequence of pixel brightness multipliers. The random 
to sequence is formed from four Yobust-watermarking-pa- 
rameters' selected and known only by the marker and/ 
or the marking entity A watermarking plane is generated 
which has an element array with one-to-one element 
correspondence to the element array or arrays of the 

'5 digitized image being marked. Each element of the wa- 
termarking plane is assigned a random value dependent 
upon a robust random sequence and a specified bright- 
ness modulation strength. The so generated water- 
marking plane is imparted onto the digitized image by 

20 multiplying the brightness value or values of each pixel 
by its corresponding element value in the watermarking 
plane. The resulting modified brightness values impart 
the random and relatively invisible watermark onto the 
digitized image. Detection of an imparted watermark re- 

25 quires knowing the watermarking plane with which the 
watermark was imparted. Regeneration of the water- 
marking plane requires knowledge of the robust -mark- 
ing-parameters used in its formulation. This is generally 
only known to the marker and/or marking entity. Once 

^0 regenerated the watermarking plane is used together 
with a verifying image located in a Visualizer' to demon- 
strate the existence of the watermark. 

Brightness alteration is the essence of watermark 
imparting according to the present invention. Pixel 

35 brightness, as used herein, expresses the brightness of 
a visual stimulus in terms of the CIE 1931 Standard 
Colorimetric Observer and Coordinate System tristimu- 
lus component brightness X, Vand Z that correspond 
to a matching mixture of three reference stimuli. A more 

*o detailed description of pixel brightness is found in G. 
Wyszecki and W. S. Styles, "Colour Science: Concepts 
and Methods, Quantitative Data and Formulae," John 
Wiley & Sons, Inc. (2nd ed.), New York, 1982, pp. 
164-169, incorporated herein by reference in its entirety. 

4 5 The CIE 1931 standard specifies three particular refer- 
ence stimuli. The stimuli are radiometric quantities, and 
as such are expressed in radiometric units such as 
watts. Grassmann's law, on which nearly all of modern 
colorimetry is based, requires use of the three specific 

50 reference stimuli, or three others that are distinct linear 
combinations of them. This is discussed in D. B. Judd 
and G. Wyszecki, "Colour in Business, Science, and In- 
dustry, " (3rd ed.), John Wiley & Sons, Inc., New York, 
1975, pp. 45-47, incorporated herein by reference in its 

55 entirety. By modifying only a pixel's brightness, its col- 
our, represented by its hue and saturation, is not 
changed. This is accomplished by preserving the ratios 
of X.Vand Z.V while changing the magnitude of Y A 
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pixel represented in any nonlinear colour space, such 
as the colour space of the subtractive dyes Cyan, Ma- 
genta. Yellow and Black (CMYK) used in colour printing, 
will be translated to the X, KZcolour space (or to a colour 
space linearly related to it) before the pixel's brightness 
is modified. 

Figure 1 shows a block diagram of a system em- 
bodiment for imparting a relatively invisible watermark 
on a digitized image in accordance with the present in- 
vention. Figure 1 shows an image capture and distribu- 
tion system 150 suitable for use in accordance with an 
embodiment of the present invention. A scanner 100 
captures image data 101 from a physical source 102. 
The physical source 102 is typically a painting or pho- 
tograph. The image sends data 101 to a digital computer 
104. The computer 104 includes a working storage 106 
that is typically embodied in the computer's random ac- 
cess memory, an image storage system 1 08 that is often 
a conventional hard disk drive, and an image archive 
110 that can be a tape or disk storage. The computer 
1 04 also includes a number of software modules. These 
include front end image processing software 112 that 
performs image processing such as scaling and en- 
hancement of the image data provided by the scanner 
100. It also includes colour preserving watermarking 
software 1 1 4 operating in accordance with the principles 
of the present embodiment, and back-end image 
processing software 1 1 6 that performs other processing 
functions such as compression on the watermarked im- 
age. Most often, the unprocessed or front-end digitized 
original image 101 is sent to the image archive 110 for 
preservation in un watermarked form. 

An alternate embodiment has the original image al- 
ready available in digitized form 101 without requiring a 
scanner 100. The watermarking software 114 applies a 
relatively invisible watermark to the digitized image 101. 
The watermarking process can also be performed on a 
copy of an archived image or on other scanned and 
processed image data, which has been loaded in whole 
or in part, into the computer's working storage 106. 

The processed, watermarked and compressed im- 
age produced by the combination of the software mod- 
ules 112-116 is sent from the working storage 106 or 
image storage 108 to an image server 118 that is con- 
nected to a digital network 120. When appropriate, the 
digital network is interconnected with a Local Area Net- 
work (LAN), a Wide Area Network (WAN) such as the 
Internet, or both. Other systems 122 connected to the 
digital network 120 can request and receive images 
stored on the image server 118 via the digital network 
120. In some cases, the systems can then display the 
received images on a display device 1 24 and/or print 
the images on a graphics capable printer 126. Those 
skilled in the art will recognize that there are many other 
system configurations in which the present invention 
could be employed. The system of Figure 1 is generally 
also useful for detecting and demonstrating the exist- 
ence of the watermark in a manner such as those de- 



scribed subsequently. 

MARKING AN IMAGE WITH A ROBUST 
WATERMARK 

5 

In one embodiment, the watermark imparted onto 
the digitized image is a monochrome pattern, herein 
called "the watermarking plane," that overlays the digi- 
tized image. The pattern is embodied by selecting its 

io element values from a robust random sequence formed 
from a group of robust sequence generating parame- 
ters. The parameters are used to generate a generally 
strongly encrypted random sequence in a manner well 
known to those skilled in the art. These parameters are 
herein referred to as the 'robust-watermarking-parame- 
ters*. In a preferred embodiment, these parameters in- 
clude a cryptographic key, two coefficients of a linear 
random number generator, and an initial value of the 
random number generator. 

20 Each value, or group of values, of the robust ran- 
dom sequence is associated with one of the pixels of 
the digitized image. Most often the values of the random 
sequence are linearly remapped to meet particular cri- 
teria. All the brightness values of the plurality of colour 

2S planes of each pixel are multiplied by its associated lin- 
early remapped robust random sequence value called 
its brightness multiplying factor or multiplying factor. A 
brightness multiplying factor which modifies element 
brightness values by less than ten percent is herein re- 

30 ferred to as a brightness multiplying factor producing a 
relatively invisible watermark. It is noted that depending 
on the texture of the image being watermarked, the 
brightness values are generally modified on average by 
a percentage factor of only 0.3 to 4 percent, and rarely 

35 up to 6 percent. This is in order to make the marking 
less visible. The percentage factor is herein referred to 
as the modulation strength. The actual modulation 
strength employed is dependent upon the classification 
level of invisibility required by the particular use. It is not 

4 o advisable to employ a brightness multiplying factor 
greater than unity. This can result in some pixel bright- 
ness values being greater than one. If employed, it is 
recommended that all brightness values greater than 
one be clipped to a value of unity. This can alter the pix- 

4S el's colour, thus altering the appearance of the image. 

Impaning a watermark upon a digitized image by 
varying the brightness of each pixel with a multiplying 
factor maintains each pixel's colour by satisfying Grass- 
mann's law. A compromise is generally made in select- 
50 ing modulation strength. A smaller percentage makes 
the watermark less visible but more difficult to detect. A 
larger percentage makes it easier to detect and demon- 
strate the existence of the watermark, but makes the wa- 
termark more visible. A highly textured image may re- 

55 quire the use of a relatively high modulation strength. 
An imparted watermark is considered to be undetecta- 
bly invisible in all cases if the modulation strength is less 
than 0.5%. even when the unmarked digitized image is 
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a uniform medium gray. For digitized images having 
more practical and valuable features, subliminally invis- 
ible watermarks generally have modulation strengths of 
1 % to 3%, depending on the degree of textural variation 
in the image itself. 

The watermark imparted in accordance with this in- 
vention is selected so as to appear to be relatively invis- 
ible to any person having normal or corrected visual ac- 
commodation. The probability of a false-positive detec- 
tion of the watermark in an image when it does not exist 
is less than one in a million. It is possible to vary the 
degree of imparted watermarking onto the image so that 
the watermark can be made as detectable as necessary 
consistent with a required invisibility classification. The 
detected watermark is translatable to a recognizable 
visual image having relatively bold features and with a 
very high contrast ratio. The watermark once imparted, 
is very difficult to remove or to be rendered undetectable 
without reducing the usefulness and/or value of the dig- 
itized image. 

In an embodiment of this invention, marking a digi- 
tized image with an invisible watermark requires the for- 
mation of a plane for watermarking. The invisible water- 
mark is herein represented as a rectangular array of nu- 
meric elements, henceforth referred to as the water- 
marking plane, having / rows and J columns. The / rows 
and J columns correspond to the dimensions of the en- 
tire original digitized image, or a portion thereof, to which 
it is being applied. 

When an original digitized image is very large, a 
generated watermarking plane not large enough to cov- 
er the entire original image is extended by tiling replica- 
tion in any direction necessary to cover the entire image. 
If a watermarking plane being so tiled extends beyond 
any edge of the original image, the plane is assumed to 
be truncated. These conventions are adopted for this 
embodiment to allow every pixel of the original image to 
have its brightness altered and to ensure that the 
marked image is equal in size to the original image. This 
forms a one-to-one correspondence between element 
locations in the watermarking plane and pixels in the col- 
our planes of the original image. This is generally a de- 
sirable implementation, even though alternate embodi- 
ments do not require watermarking the entire image. 

In a preferred embodiment, the value of each ele- 
ment in the array defining the watermarking plane is lin- 
early remapped to be a random number in the range, 



1 < j < J, 



(3) 



where, 



and 



1 > *v(i,j)>(1 -2p), 



1 < i < /, 



(1) 



(2) 
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are the row and column indices of the array, and p is the 
modulation strength of the watermark such that, 



0.1 > p > 0. 



(4) 
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Additionally, all elements in the generated water- 
marking plane, treated as an ensemble, are adjusted to 
have a mean and median of 1 -p. 

Imparting the watermark onto an image begins with 
generation of this watermarking plane. The watermark 
is imparted onto the original image by multiplying all the 
imparted brightness values associated with the colour 
planes of each original image pixel by the value in its 
corresponding element in the watermarking plane. 



20 CONSTRUCTING THE WATERMARKING PLANE 



The construction of the watermarking plane is fun- 
damental to insuring the robustness of the imparted wa- 
termark and its ability to survive even determined at- 
tacks. To this end, the procedure by which the values of 
the watermarking plane elements are chosen is based 
on cryptographic and two-dimensional signal process- 
ing theory techniques. These are used to satisfy partic- 
ular requisite properties of the watermarking plane. 



THE PROPERTY OF UNPREDICTABLE 
RANDOMNESS 

Consideration is now given to the values of the wa- 
termarking plane elements to meet the property of un- 
predictable randomness. Unpredictable randomness 
requires that each element's value should vary random- 
ly from the values of its neighbours, and the sequence 
of element values should be essentially unpredictable. 
Random variation of the elements is required for the wa- 
termark to be rendered relatively invisible. In as much 
as pattern recognition is one of the most dominant char- 
acteristics of the human visual system, the presence of 
any pattern among elements of the watermarking plane 
could make it visible. The unpredictability of the se- 
quence of values is required to make the watermark ro- 
bust and less vulnerable to attack. It is recognized that 
if all values in the watermarking plane could be predict- 
ed, the watermarking process could easily be reversed 
and the mark removed. This could thereby be used to 
essentially restore the marked image to a nearly perfect 
copy of the original unmarked image. Thus, a means of 
generating a highly unpredictable random number se- 
quence is preferred. 

Generating random values by a congruence meth- 
od, typical of nearly all popular pseudorandom number 
generating algorithms, is not considered herein to pro- 
vide an adequate level of unpredictability. These se- 
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quences have only modest cryptographic strength and 
are relatively easily discernible by crypto-analytic tech- 
niques. This is described in "The Cryptographic Security 
of Truncated Linearly Related Variables," J. Hastad and 
A. Shamir, Proceedings of the 17th Annual ACM Sym- 
posium on the Theory of Computing, 1 985, pp 356-. 362, 
which is herein incorporated by reference. 

For the purposes of this embodiment a sequence is 
generated by using a strong cryptographic method such 
as the National Standard Data Encryption Algorithm. 
This is described in: "American National Standard Data 
Encryption Algorithm," ANSI X3. 92-. 1981, American 
National Standards Institute, New York; and in A. G. 
Konheim, et al., "The IPS Cryptographic Programs," 
IBM System Journal, Vol. 19, No, 2, 1980, pp 253-283; 
which are herein incorporated by reference. 

The data sequence of eight-bit values to be encrypt- 
ed is selected by the marker, and is desirably generated 
by a congruence algorithm. However, the robust secure 
sequence is produced by action of the strong encryption 
algorithm on that data. Using this approach, a highly un- 
predictable watermarking plane can be produced. More- 
over, it can be reproduced exactly by knowing only its 
four Yobust-watermarking-parameters'. These parame- 
ters are the initial state and the two coefficients of the 
congruence algorithm, and the cryptographic key used 
by the encryption algorithm. These algorithms generally 
produce sequences of values having eight-bits. Sixteen- 
bit values, referred to as a(i,j), are generated by con- 
catenating two of the sequential eight-bit values pro- 
duced by the encryption algorithm. Each sixteen -bit val- 
ue so produced is linearly remapped to become an ele- 
ment of the array defining the watermarking plane as 
follows: 

Additionally, all elements in the w(ij) array, treated 
as an ensemble, are adjusted to have both a mean and 
median of 1 -p. Ease of reproduction of the resulting en- 
crypted sequence is important for watermark detection 
and demonstration techniques discussed subsequently. 
Other remapping or normalization techniques producing 
particular desired results are known to those familiar 
with the art. 

THE PROPERTY OF EXPLICIT LOW FREQUENCY 
CONTENT 

Another important consideration is for an embodi- 
ment that exploits the property of explicit low frequency 
content. Significant high frequency content results when 
the watermarking plane is composed by placing a 
unique random value in every element. Although high 
frequency content is beneficial in making the watermark 
less visible, it also makes it vulnerable to attack for wa- 
termark damage or extinction. This is evident from the 



12 

following consideration. The highest pattern frequency 
achievable in a digital image is obtained by replicating 
a pair of adjacent pixels that have opposite extreme val- 
ues. When the image is reduced in size, if image reduc- 
5 tion filtering is used, the values of adjacent pixels are 
combined in a weighted average to form pixel values of 
the reduced image. If image decimation is used, pixels 
are selectively discarded. In either event, the high fre- 
quency content in the original image is lost in the re- 
*0 duced image. Any significant high frequency content in 
the applied watermarking plane becomes obliterated in 
the reduced image. Subsequent detection of the water- 
mark imparted prior to the size reduction is very difficult 
if not impossible. The purposeful addition of low fre- 
15 quency content makes the watermark less vulnerable to 
this type of attack. However, the deliberate inclusion of 
significant low frequency content in the watermarking 
plane is another dichotomy. Its inclusion indeed makes 
the watermark less vulnerable to normal image manip- 
20 utation and therefore more easily detectable. However, 
it generally makes the watermark more visible by pro- 
ducing a pattern with larger features in the watermarking 
plane. It is generally preferable to add only a controlled 
amount of low frequency content. 
25 The deliberate addition of low frequency content to 
the original watermarking plane is accomplished in one 
embodiment by employing the discrete two-dimensional 
Fourier transform. First, a reduced-size watermarking 
plane is formed whose elements are uniformly distribut- 
ee ed random values in accordance with the secure se- 
quence described above. For discussion purposes, a 
square plane w(\x,v) having 0<u<L-1 rows and 0<v<L-1 
columns is used. The discrete Fourier transform of the 
square plane is computed. Since all values of w(n,v)are 
35 real numbers, advantage can be taken from its complex- 
conjugate symmetry. The complete Fourier transform 
can be specified as the array of complex numbers W(o, 
x) having dimensions 0<a<L-1 and 0<x<U2. t and is sym- 
bolized as: 

40 

W(a,T)=F[w(u-, v)) (5) 

The frequency domain array W(o,x)-space is rem- 
45 apped into an expanded array W(s,t), where: 

0<s<L-1, 0<a<L/2, and L=2 P L, (6) 

50 thus enlarging the (o\x) by the factor 2P in each 

dimension forming the (s,f)-space. If W(o,x) is defined 
such that W(0,0) \s the coefficient of the constant or "ze- 
ro-frequency" term, then: 

55 

W(L-sJ)=W(L-o,x), (7) 
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and 



for 



and 



W(s r t)=W(o,z), 



0<s=o<U'2 and 0<t=t<L/2, 



W(s,t)=0, 



(8) 



(9) 



(10) 



tor all other values of s and t. This technique is 
herein referred to as "zero-padding. " 

The inverse Fourier transform of W(s,t) provides the 
modified watermarking plane w(m, n) having 0<m<L-\ 
rows and 0<n<L-1 columns. If, for example, p = 2 and 
L=512, then w(m,n) is a square array having 2048 rows 
and columns. More importantly, however, w(m,n)ha$ an 
assured low frequency content with a minimum period 
(2P=2 2 =4)four times longer than the minimum period 
possible in a 2048 2 image plane. Since its generating 
kernel, w(\x,v), contains 262,144 random values taken 
from a secure sequence, its vulnerability to attack by 
brute force replication is relatively small. In a case where 
a thusly marked image appears to be vulnerable, its ker- 
nel can easily be made larger. 

Still lower frequency content can be impressed by 
using a p=3 making the highest frequency to be one 
eighth of the original highest frequency. The preferred 
embodiment uses p=2 so as not to over employ low fre- 
quency content that may cause the watermark to be- 
come undesirably visible. 

The values of some elements of the generated wa- 
termarking plane so far produced may exceed one. 
Since each value is to be used as a multiplier of pixel 
brightness, it is therefore possible to produce a multi- 
plied pixel brightness that is greater than one, which is 
a brightness that can not physically be displayed. In this 
event, any multiplied pixel brightness greater than one 
would have to be clipped to the maximum that can be 
displayed. The preferred embodiment, however, em- 
ploys an additional process step to avoid the possible 
need for clipping. Before the generated modified water- 
marking plane is used, its elements, forming an ensem- 
ble, are adjusted to make both their mean and median 
values equal to 1-p and the maximum value equal to 1. 
With these adjustments, the requirement that, 



^>w(i,j)>(^-2V) t 



(11) 



for all / and j is satisfied. At this point, it is sometimes 
advantageous to "hard clip" the elements. In this situa- 
tion, elements with values greater than or equal to 1-p 
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are set to 1 , and elements with values less than 1 -p are 
set to 1-2(i. Hard clipping normally increases the prob-. 
ability of detecting a watermark, but unfortunately, it also 
tends to make watermarking artifacts more visible in the 
marked image. 

THE PROPERTY OF PLANE EXPANSION BY TILING 

The fact that the watermarking plane w(m,n) is pro- 
duced as the result of an inverse discrete Fourier trans- 
form is very useful. If the watermarking plane is not large 
enough to cover the entire unmarked image, if L</ or 
L<J, it can be enlarged seamlessly by tiling replication 
downward or to the right to make a plane as large as 
desired, with each tiled extension adding an additional 
4,1 94,304 elements. For the example dimensions used 
here, tiling replication is: 



where, 



w(m',n') - w(m,n), 



m' = (2048p) + m, 



n' = (2048q) + n, 



(12) 



(13) 



(14) 



and p and q are nonnegative integers. 

In one embodiment, a watermarking plane is formed 
following the steps 202-216 shown in Figure 2. These 
steps are herein referred to as the 'ideal interpolator wa- 
termarking plane generating method'. Firstly, an eight- 
bit pseudorandom sequence is generated, 202. The re- 
sulting sequence is encrypted to form a secure se- 
quence of eight-bits values, 204. Sixteen bit integer 
samples are formed by concatenating two abutted val- 
ues from the secure sequence, 206. The sixteen bit in- 
teger samples are linearly remapped and formed into a 
w(\jl,v) array such that, 



1>w(u.,v)>(1-2P), 



(15) 



208. The Fourier transform frequency domain array W 
(o,t) is computed from w(j-i,v), 210. The W(c,x) coordi- 
nates are expanded by zero-padding to form expanded 
frequency domain array W(s,t), 212. The preliminary 
watermarking plane array w(m,n) is computed by taking 
the inverse discrete Fourier transform of W(s,t), 214. 
The elements of the preliminary array w(m,n)are adjust- 
ed to collectively have a mean and median of (1-p) and 
a maximum of 1 , 21 6a. Alternatively, the elements w(m, 
n) are hard clipped to have only values of 1 or 1 -2p, with 
a median of 1-p, 216b. The resulting adjusted array w 
(m,n) is the watermarking plane with elements that are 
brightness multiplying factors to be used for adjusting 
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corresponding pixels of the image being watermarked. 

The method presented here, employing forward 
and inverse discrete Fourier transforms to generate the 
water-marking plane, is an "ideal interpolator" with as- 
sured low frequency content. Other methods known to 
those skilled in-the-art are available. These include 
methods that use two-dimensional interpolation filters 
that can similarly be employed to produce acceptable 
results. 

The generated watermarking plane is then imparted 
onto the original unmarked digitized image. Figure 3 
shows an embodiment for the steps of watermark im- 
parting. First, the watermarking plane is expanded by 
tiling to completely cover the image being watermarked, 
302, This forms a one-to-one correspondence of an el- 
ement in the expanded watermarking plane and a pixel 
in the original image. The brightness values of each pix- 
el in the original image are multiplied by the value in its 
corresponding element in the expanded watermarking 
plane, 304. The resulting image with the new brightness 
values forms the watermarked image. The relative visi- 
bility of the watermark in the image is observed in rela- 
tionship to the desired visibility classification level mark- 
ing. If the marking is more visible than specified the 
steps of Figures 2 and 3 are repeated for a lower mod- 
ulation strength. A watermark created with a lower mod- 
ulation strength is generally less easily detected and 
demonstrated to exist. One the other hand, if the result- 
ing watermark is less visible than specified, the steps of 
Figures 2 and 3 may be repeated to provide a watermark 
with a higher modulation strength. A watermark created 
at a higher modulation strength is generally easier to de- 
tect and have its existence demonstrated. Once impart- 
ed, an invisible watermark only serves its purpose if it 
can be detected and shown to exist. 

FINDING AN INVISIBLE WATERMARK HIDDEN IN A 
MARKED IMAGE 

It is most desirable to demonstrate the existence of 
the watermark with a visible image having bold features. 
This is herein employed using an image array called a 
"visualizer." Demonstration of the existence of the wa- 
termark imparted in accordance with the present inven- 
tion requires a regeneration of the watermarking plane 
with which it was marked. This can generally only be 
performed by the marker and/or marking entity who 
alone knows the four parameters making up this appli- 
cation's Vobust-watermarking-parameters'. Knowledge 
of these parameters is required for generating the robust 
random sequence used in forming the watermarking 
plane. From these four parameters the robust random 
sequence is reformed. Values of the sequence are used 
to define the values of the elements. If a linear remap- 
ping process was employed in the generation of the wa- 
termarking plane : the element values are linearly rem- 
apped using that same process to redefine the expand- 
ed watermarking plane. The thusly reformed expanded 



watermarking plane is used in conjunction with the vis- 
ualizer to demonstrate the existence of the expanded 
watermarking plane in the image. This is accomplished 
as described subsequent to an overview of watermark 

5 detection considerations. 

Finding an invisible watermark hidden in a marked dig- 
itized image is a relatively difficult problem, and it is 
made more so by manipulations of the marked image 
that may have occurred. The watermark survives and is 

10 detectable for image manipulations that in themselves 
do not damage the image beyond usability. The detec- 
tion method of the present embodiment can find an im- 
parted watermark with a high degree of certainty in near- 
ly all such cases. A significant advantage of the present 

15 method is that watermark detection does not require ac- 
cess to a copy of the entire original image. In most cas- 
es, all that is required is the watermarking plane used 
for imparting the watermark on the image. A perfect 
copy of the watermarking plane is reconstituted from its 

20 four defining parameters. If a copy or if even only a frag- 
ment of the original image is available, detection can 
have a somewhat higher probability of success. 



25 



REORIENTING AND RESIZING THE 
WATERMARKING PLANE 



A first consideration in finding a watermark is to de- 
termine how and by how much the marked image may 
have been manipulated It may have been reduced in 

30 size A size reduction may even have been performed 
nonlinearly, such that its horizontal and vertical dimen- 
sions may have been reduced by unequal factors. The 
image may also have been rotated, not by an obvious 
ninety degrees, but by a small angle. Facilitating this de- 

3S termination is the knowledge that pixel values in the un- 
manipulated marked image are directly related to corre- 
sponding elements in the watermarking plane. If a sig- 
nificant fragment of the original image is available, a 
fragment of the unmanipulated marked image can be 

to reconstructed. Either the reconstituted watermarking 
plane or a reconstructed fragment of the marked image 
is a suitable "correlation reference plane." 

An overview of the steps of reconstructing a manip- 
ulated watermarked image is shown in Figure 4. First, 

45 the watermarking plane used for imparting the water- 
mark onto the image is regenerated from the four 'ro- 
bust-watermarking-parameters' generally only known to 
the marker and/or the marking entity, 402. Secondly, the 
marked image is resized and rotated to its known origi- 

so nal dimensions, 404. Thirdly, the resized and rotated im- 
age is aligned with the expanded regenerated water- 
marking plane such as to provide one-to-one corre- 
spondence of the elements of each with the elements 
of the other, 406. 

5 $ In an actual implementation the steps of reorienting 
and resizing the marked image may be broken into a 
coarse placement followed by a fine alignment. The 
coarse placement is performed by visual inspection of 
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a displayed copy of a portion or the complete marked 
image overlaying a corresponding portion or complete 
correlation reference plane. The correlation reference 
plane is reoriented and resized to the size and orienta- 
tion of the marked image by axis reduction or expansion, 
translation and/or rotation. This is accomplished using 
techniques well known to those skilled in the art. The 
coarse placement generally brings the correlation refer- 
ence plane to within 4 percent of the manipulated 
marked image's size and within four degrees of its ori- 
entation. 

Figure 5 shows the steps for an embodiment for per- 
forming coarse placement. Both the marked image and 
the correlation reference plane are displayed on a com- 
mon display, 502. The vertical axis and horizontal axis 
magnification, offset and angular rotation of the correla- 
tion reference plane display are varied to make the dis- 
played correlation reference plane closely overlay the 
corresponding portions of the displayed manipulated 
marked image, 504. The values of the magnification/re- 
duction factors, horizontal and vertical offsets and angle 
of rotation are noted and stored, 506. The entire marked 
image is rescaled, translated and rotated by the recip- 
rocals of the noted values so that it visually matches the 
correlation reference plane, 508. The so coarsely ma- 
nipulated reconstituted marked image is further manip- 
ulated to perform the fine alignment. 

According to the Fourier Shift Theorem, Rotation 
Theorem and Scaling Theorem, the properties of trans- 
lation, rotation and scaling transcend the Fourier trans- 
formation of an image, and, if present in w(m,n), each 
will also be present (or, in the case of scaling, its recip- 
rocal will be present) in W($,t). This is useful to deter- 
mine a more precise angle of rotation, horizontal and 
vertical scale factors, and translation offsets of the cor- 
relation reference plane relative to the marked image. 
This is accomplished by first constructing a three-di- 
mensional "array of phase-correlation maxima." The 
three axes of the array correspond to the horizontal 
scale factor, the vertical scale factor, and the angle of 
rotation of the correlation reference plane relative to the 
marked image. Phase-correlation is defined as follows. 
Let W(s.t) be the discrete Fourier transform of the cor- 
relation reference plane, U(s,t)be the Fourier transform 
of the marked image u(m,n), and U~(s,t) be the complex 
conjugate of U(s,t). The phase-correlation plane p(m,n) 
is computed using the relationship: 



The value at each array point is the maximum mag- 
nitude of the corresponding phase^correlation plane. It 
is computed using an incrementally rescaled and rotat- 
ed correlation reference plane. Any one of the colour 
planes of the marked image usually suffices as the re- 
quired array u(m,n). Interpolating among the values of 



the three-dimensional array yields coordinates of the 
greatest -of-the-greatest phase-correlation maxima. 
From these coordinates, values of the horizontal and 
vertical scale factors and angle of rotation of the corre- 
5 lation reference plane relative to the marked image are 
directly read. The correlation reference plane is then re- 
scaled and rotated to more precisely align it with the ma- 
nipulated marked image. A final phase-correlation eval- 
uation is made to determine the relative horizontal and 
10 vertical offsets of the modified correlation reference 
plane relative to the manipulated marked image. Finally, 
the entire marked image is rescaled, translated and ro- 
tated in accordance with the measured values to restore 
it to its original size and orientation. The thusly modified 
'5 marked image is now ready for use in the detection and 
demonstration process to show the existence of the wa- 
termark in the manipulated marked image. 

In one embodiment the fine alignment of the corre- 
lation reference plane relative to the marked image is 
20 performed by evaluating a three-dimensional array of 
phase-correlation maxima, and then interpolating within 
that array to find the location of the maximum of those 
maxima. The axes of the array are the horizontal mag- 
nification, vertical magnification and angular rotation 
25 that are systematically applied to the correlation refer- 
ence plane. All combinations of the following incremen- 
tal steps define the values of the coordinates of the ar- 
ray. The vertical axis of w(m,n) is magnified/reduced 
from 96% to 104% of its original size in 2% increments. 
30 in similar fashion the horizontal axis of w(m,n) is mag- 
nified/reduced from 96% to 1 04% of its original size in 
2% increments. Also in similar fashion w(m,n) is rotated 
relative to its original orientation from -5 degrees to +5 
degrees in 2 degree steps. At each combination of ver- 
35 tical magnification, horizontal magnification, and angu- 
lar rotation of the correlation reference plane, the phase- 
correlation plane p(m,n) is recomputed as above. The 
maximum of the point values p(m*,n*) in the plane is 
stored into the three-dimensional array of phase-corre- 
40 lation maxima at coordinates corresponding to each of 
the incrementally adjusted values of vertical magnifica- 
tion, horizontal magnification, and angular rotation. 

A flow diagram of this embodiment is shown in Fig- 
ure 6. Those skilled in the art know there are many sat- 
4 $ isfactory algorithms available to magnify/reduce and ro- 
tate digitized images. Any one of those algorithms can 
be used for manipulation of the correlation reference 
plane in the following description. As described above, 
the discrete Fourier transform of the marked image U(s, 
so t) is formed, 602. Initial values are set for stepping var- 
iables vertical magnification, Vrn=0.96, horizontal mag- 
nification, Hm=0.96, and angular rotation, Ar=-5°, 604. 
The correlation reference plane is vertically magnified/ 
reduced according to Vm, 607. The so adjusted plane 
s $ is then horizontally magnified/reduced according to Hm, 
608. The so adjusted plane is then angularly rotated ac- 
cording to Ar, 609. The discrete Fourier transform of the 
so adjusted plane W(s,t) \$ formed, 610. The phase-cor- 
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relation plane p(m,n) is calculated using the relationship 
of equation (16), 611. The p(m,n) plane is examined to 
find the coordinates (nrT.n*) of its maximum value, 612. 
The coordinates (m*.n*) and p(m*,n*) are stored in the 
three-dimensional array being formed. The three-di- 
mensional array is indexed by Vm, Hm and Ar, 61 3. The 
value of Ar is examined, 614. If it is less than plus five 
degrees, it is incremented by plus two degrees, 6 1 5, and 
steps 609-614 are repeated until Ar is found to be plus 
five degrees in step 614. When Ar is found to be plus 
five degrees in step 614, the value of Hm is examined, 
616. If Hm is less than 1.04, it is incremented by 0.02 
and Ar is reinitialized to minus five degrees, 617. Steps 
608 to 616 are repeated until Hm is found to be 1 .04 in 
step 6 1 6. When Hm is found to be 1 .04, Vm is examined, 
618. If Vm is found to be less than 1 .04, it is incremented 
by 0.02, and Ar is initialized to minus five degrees, and 
Hm is initialized to 0.96, 619. Steps 606 to 618 are re- 
peated until Vm is found to have a value of 1 .04 in step 
618. When Vm is found to be equal to 1 .04, the values 
of the three-dimensional array are interpolated to find 
the maximum of the maxima peaks : 620. The resulting 
coordinates of the maximum of maxima peaks provide 
the final values for the vertical multiplier, the horizontal 
multiplier and the rotational angle for best alignment of 
the manipulated marked image with the correlation ref- 
erence plane. The corresponding resulting values of m* 
and n* of the maximum of maxima provide the offset dis- 
placements of the manipulated marked image relative 
to the correlation reference plane. The manipulated 
marked image is then rescaled by the reciprocal of the 
found vertical and horizontal multipliers. It is rotated by 
the reciprocal (negative) of the found angular rotation, 
and is offset by the negatives of m* and n*, 622. This 
completes the fine setting process of reorienting and re- 
sizing. 

It will be apparent to those skilled in the art that ei- 
ther the correlation reference plane or the manipulated 
marked image can be resized and reoriented to bring 
one into alignment with the other. The preferred embod- 
iment resizes and reorients the manipulated marked im- 
age to bring it into alignment with the correlation refer- 
ence plane, and hence into element-to-element align- 
ment with the watermarking plane. 

DETECTING THE WATERMARK IN A MARKED 
IMAGE 

The process of watermark detection is designed to 
produce a visibly recognizable small image as its end 
product. The recognizable end product is obtained in a 
procedure which depends upon the existence and 
knowledge of the watermark based on the secure ran- 
dom sequence. The process exploits the extremely so- 
phisticated and not yet completely understood pattern 
recognition capabilities of the human visual system. It is 
through this exploitation that defeating the imparted wa- 
termark becomes much more difficult. A small rectan- 



gular array, called a selector, is conceived to implement 
the detection process. The selector array size must be 
much smaller than the pixel array of the marked image 
to which it is being applied. This is to allow overlaying 
the selector on the image hundreds of times without 
overlapping. The selector array should be made large 
enough that a pixel array having the same dimensions 
could contain a recognizable binary image. More com- 
plex embodiments use a colour rather than binary image 
as a reference. A selector having 32 rows and 128 col- 
umns is used in an embodiment described herein. It is 
applied to a marked image that has more than one mil- 
lion pixels. 

The selector is used to locate rectangular clusters 
of pixels in the marked image and corresponding clus- 
ters of elements in the reconstituted watermarking 
plane. The clusters are randomly scattered non-over- 
lapping positions. Random scattering of the clusters is 
done to further frustrate attempts to defeat watermark 
protection. Each element of the selector contains one 
or more devices associated with variables that serve to 
store partial results of the watermark detection scheme. 
One embodiment uses two selector devices, one called 
a "coincidence counter" and the other a "non-coinci- 
dence counter." 

A variable is defined which statistically relates an 
attribute of an element being considered to the attributes 
of its neighbouring elements. For each pixel in the 
marked image a first variable is computed for that pixel 
and a second variable is computed for that pixel's cor- 
responding element in the reconstituted watermarking 
plane. A positive test results when the computed first 
variable has the same result, or a nearly or statistically 
deemed equivalent result, as the computed second var- 
iable. If the results are deemed to be different, the test 
result is deemed to be negative. The first variable is rec- 
omputed and compared with the second variable for 
each of that pixel's colour planes. The coincidence 
counter associated with that selector element is incre- 
mented by unity for each colour plane producing a pos- 
itive result and the non-coincidence counter is incre- 
mented by unity for each colour plane that produces a 
negative result. The purpose of each element's coinci- 
dence and non-coincidence counters is to associate 
with that element a confidence level of the watermark's 
identification with the random sequence known only to 
the marker and/or the marking entity. 

For a tristimulus colour image and for each cluster 
of pixels, the range of each coincidence counter value 
is from zero to plus three. A zero is obtained if the test 
results were negative for all three colour planes. A plus 
three is obtained if the test results were positive for all 
three planes. The range of each non-coincidence coun- 
ter is also from zero to plus three, but conversely, a zero 
is obtained if the test results for all three planes were 
positive and a plus three is obtained if the test results of 
all three planes were negative. The count in each coin- 
cidence counter is the accumulated sum of the counts 
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of positive results for corresponding pixels at each clus- 
ter location, and the count in each non-coincidence 
counter is the accumulated sum of the counts of nega- 
tive results for corresponding pixels at each cluster lo- 
cation. A coincidence counter value larger than the val- 
ue of its corresponding non-coincidence counter is as- 
sociated with a partial watermark detection. A compos- 
ite of coincidence counter values greater than their cor- 
responding non-coincidence counter values for a pre- 
ponderance of the selector's elements results from and 
corresponds with a detected watermark. 

In an embodiment the test results and/or the com- 
parison are performed by subtraction operations. In a 
particular embodiment the attribute used is the pixel's 
brightness values The statistical relationship is in re- 
gard to the average brightness value of the neighbour- 
ing pixels, (n this case, watermark detection proceeds 
with the steps shown in Figure 7 A selector array size 
is selected, 702. In this example, the selector array size 
is 32 by 1 28 elements. All the coincidence and non-co- 
incidence counters are initialized by setting them to read 
zero, 704. A specified particular element of the selector 
is placed on an initial position of the expanded water- 
marking plane, 706. The particular first element is often 
the selector element that is at its upper leftmost corner. 
This particular element also locates a corresponding 
pixel and its components in all the colour planes of the 
marked image when the marked image is aligned with 
the expanded watermarking plane. 

The following portion of the detection schema is re- 
peated iteratively for all selector elements, for all colour 
planes of each pixel, and for all selected clusters. The 
next two eight-bit integers are chosen from the regen- 
erated secure random sequence, 708. When the sche- 
ma is started for the first selector element, the next two 
eight-bit integers chosen in this step 708 are actually 
the first two eight-bit integers of the secure random se- 
quence. The two eight-bit integers are scaled to form 
random horizontal and vertical offsets from the initial or 
previous selector location, and the selector is moved to 
that position, 710. The selector element sequence is re- 
set to the coordinates of the initial particular selector el- 
ement, 711. This selector element is used to locate the 
corresponding particular element in the watermarking 
plane, 712. The average magnitude of its neighbouring 
elements in the watermarking plane is computed, 713. 
In the example, this is the average of the magnitudes of 
the particular element's neighbours that lie in an 11 by 
1 1 square of elements with the particular element at the 
center of the square. If the selector element is too near 
an edge of the watermarking plane to be at the center 
of its neighbourhood, the square neighbourhood is 
moved to encompass the particular element's nearest 
120 existing neighbours. 

The next colour plane is chosen, 714. In the begin- 
ning of this iterative schema this next colour plane is 
actually the first colour plane. In the case of a mono- 
chromatic image this is the only colour plane. The coor- 



dinates of the particular selector element are used to 
locate a corresponding pixel colour element in this next 
colour plane, 715. The average brightness of the neigh- 
bouring 120 pixel colour elements is computed. 716, in 

s a manner identical to that stated above for watermarking 
plane elements. The values of the particular watermark- 
ing plane element and the corresponding pixel colour 
element are compared to their respective neighbour- 
hood averages. If both values are equal to or greater 

10 than their respective neighbourhood averages, 717, or 
if both values are less than their respective neighbour- 
hood averages, 718, the coincidence counter of that 
particular selector element is incremented, 719a. If one 
value is less than its respective neighbourhood averag- 

75 es and the other value is equal to or greater than its re- 
spective neighbourhood averages, the non-coincidence 
counter of that particular selector element is increment- 
ed, 719b. The magnitude of the value in each coinci- 
dence counter relative to the magnitude of the value in 

20 its corresponding non-coincidence counter is associat- 
ed with the probability of watermark sequence valida- 
tion. 

A determination is made if all colour planes were 
chosen for testing their corresponding brightness value 

25 with regard to its neighbouring average, 720. If not, the 
process returns to step 7 1 4 for choosing the next colour 
plane. Steps 715 to 720 are repeated for this colour 
plane. This is continued until step 720 indicates the all 
colour planes are tested. When the last (or only) colour- 

30 plane is tested, a determination is made if every element 
for that selector was chosen, 724. If not, the next selec- 
tor element is chosen, 726. Generally, the next element 
is the next right-wise adjacent element on that row. If 
there is no next adjacent element on that row, the next 

35 element is the left-most element in the next selector row 
This next selector element becomes the new particular 
element. Steps 712-724 are repeated until all selector 
elements are chosen and tested. When it is determined 
in step 724 that all elements have been chosen, a de- 

4 o termination is made if all non-overlapping selector loca- 
tions have been chosen, 728. If not, steps 708 through 
728 are repeated for all selector elements and marked 
image colour planes. When it is determined in step 728 
that all selector locations are tested, all coincidence 

45 counters have their test result values. 

Figure 8 shows a random multiple totality of posi- 
tions of the selector 8 1 0 in a selector plane 802 resu Iting 
from an implementation of the process of Figure 7. Fig- 
ure 8 shows a watermarking plane 804 and three colour 
planes 806-808 of the marked image. The first selector 
element acted upon is often the top leftmost element 
812 of the selector in each of the selector positions. It 
is noted that although each selector position is randomly 
offset from previously chosen positions, the positions do 
55 not overlap each other. 

The values contained within each coincidence and 
non-coincidence counter associates with their corre- 
sponding selector's element a confidence level of the 
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watermark's identification with the random sequence 
known only to the marker and/or the marking entity. The 
watermark is considered to be detected if a preponder- 
ance of the differences of coincidence counter values 
less their respective non-coincidence counter values s 
are nonnegative. Thus, an examination of the totality of 
these nonnegative differences explicitly suffices for de- 
claring the watermark detected or not detected. Indeed, 
this can be considered as the end of the watermark de- 
tection technique. w 

However, it is recognized that a "preponderance" of 
differences being nonnegative is an inexact measure, 
at best. Clearly, if only a simple majority of the differenc- 
es are nonnegative, whether the watermark is detected 
or not is at best a judgment call. Most likely it would be is 
conceded as not having been a detection. To assist in 
this judgment, the present embodiment exploits the abil- 
ity of the human visual system to recognize a pattern in 
a cluttered field. This is accomplished by forming a bi- 
nary image called a visualizer. The visualizer is formed 20 
to have the same dimensions as the selector (e.g., 
32x128 pixels). A clearly recognizable pattern is placed 
into the visualizer. A typical visualizer pattern is shown 
in Figure 9, 900. The black border surrounding the vis- 
ualizer is not considered to be part of the visualizer pat- 2s 
tern. The pattern is an arrangement of blocks of black 
and white pixels forming an easily recognizable pattern. 
A typical pixel : 902, is at the lower ending of the image 
of a C. The visualizer image is entirely white except for 
pixels making the letters IBM, 904, the copyright logo, 30 
906, and the visualizer frame : 908. 

The visualizer pattern is used to provide a visual im- 
age of the actual degree of "preponderance" of coinci- 
dence counters being nonnegative. The method steps 
diagrammed in Figure 10 are used to provide a water- 35 
mark signature in relation to the visualizer pattern. The 
watermark signature is derived by using the visualizer 
pattern in combination with the coincidence counter dif- 
ference data to form what is herein referred to as the 
Visualizer-coincidence image'. 40 

In one embodiment, the visualizer-coincidence im- 
age is formed with the steps shown in Figure 10. A vis- 
ualizer pattern is formed having a pixef array equal in 
size to the element array of the selector, 1002. The vis- 
ualizer array consists of white and black pixels, where 45 
white is given the value one and black the value zero. 
All elements of the selector array will be examined to 
determine the pixel content of the visualizer-coinci- 
dence image. To do this, the selector element sequence 
is reset and the first element of the sequence is chosen, so 
1004. For the chosen selector element, the count in its 
corresponding non-coincidence counter is subtracted 
from the count in its corresponding coincidence counter, 
forming a difference, 1 006. The sign of the difference is 
tested, 1 008, and if it is negative the corresponding pixel ss 
of the visualizer is inverted (white is changed to black, 
and black to white) and placed into the corresponding 
pixel of the visualizer-coincidence image. 1010b. If the 



sign is positive, the corresponding pixel of the visualizer 
is placed unmodified into the corresponding pixel of the 
visualizer-coincidence image. 1010a. The selector ele- 
ment sequence is tested to see if all elements have been 
chosen, 1012, and if not , the next element is chosen, 
1014, and steps 1006 to 1012 are repeated. If all selec- 
tor elements have been chosen, the visualizer-coinci- 
dence image is displayed, 1016. A judgement is made 
as to whether the pattern in the visualizer-coincidence 
image is recognized as a reproduction of the visualizer 
pattern. 1018. If it is recognized, the watermark is pos- 
itively detected, 1020a. If not, the watermark is not de- 
tected, 1020b. 

It is evident to those skilled in the art that if only the 
sign of the difference between the count in a coinci- 
dence counter less the count in its corresponding non- 
coincidence is to be used in constructing the visualizer- 
coincidence image, then only one counter would have 
been needed for each selector element. In that case, 
step 719a of Figure 7 would read "Increment the counter 
of Selector's Element," and step 719b would read "Dec- 
rement the counter of Selector's Element." 

Figure 11 shows a detection, 1102, resulting from 
the visualizer of Figure 8 for an imparted watermark 
made at a modulation strength of 1 %. As previously stat- 
ed in all cases the black border is not part of the visual- 
izer-coincidence image. A stronger replication of the vis- 
ualizer, 1 202, resulting for an imparted watermark made 
at a modulation strength of 2% is shown in Figure 12. A 
still stronger replication of the visualizer, 1302, resulting 
for an imparted watermark made at a modulation 
strength of 4% is shown in Figure 1 3. 

An attempt to detect a watermark in an image that 
does not have one, or in an image for which the water- 
marking plane cannot be reconstituted, produces a vis- 
ualizer pattern that is an unrecognizable random melee. 
Figure 1 4 shows a typical visualizer-coincidence image, 
1402, when a watermark is not detected. This results 
when many visualizer elements are subjected to inver- 
sion. A preponderance of elements not requiring inver- 
sion indicates watermark detection. This method in fact 
has an extremely low probability of false-positive detec- 
tion. Even in a highly textured marked image, the visu- 
alizer pattern should be clearly recognizable to signify 
a watermark detection of very high credibility. 

Clearly, more information is present in the coinci- 
dence and non -coincidence counter values than has 
been exploited above, where only the algebraic sign of 
their difference has been used. An alternative method 
of converting the visualizer image into a visualizer-coin- 
cidence image uses the magnitude of each coincidence 
counter value and that of its corresponding non-coinci- 
dence counter. If C(i'J') is the value of the coincidence 
counter associated with selector element i'.j' and C'Ci'.j') 
is the value of the corresponding non -coincide nee coun- 
ter, then the normalized magnitude of their difference e 
O'J') is: 
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e( '",7")= 



C(i'.n 



c{i\n+c\i\n 



when 



and 



for 



c(r,j')+C'(i',j')>Q : 



e(i'j')= 1/2, 



c(rj')+c'(i'j>)=o. 



(17) 



(18) 



(19) 



(20) 



In this case, the visualizer image is converted into 
a visualizer-coincidence image by replacing each pixel 
in the visualizer image with the corresponding value of 
©(i'.f). when the visualizer pixel value is one; and by 1 -e 
(i\j'), when the visualizer pixel value is zero. Notice that 
the visualizer-coincidence image is no longer a binary 
image, but includes gray shades ranging from black to 
white. The judgement as to whether the pattern placed 
in the visualizer is recognizable in the visualizer-coinci- 
dence image is the same as before, and an attempt to 
detect the presence of a known watermark in an image 
not having one, or in an image having one but for which 
the watermarking plane cannot be precisely reconstitut- 
ed, also still produces an unrecognizable random melee 
in the visualizer-coincidence image. 

Thus, this scheme makes more use of the actual 
values in the coincidence and non-coincidence 
counters. It still employs a black and white element vis- 
ualizer image pattern wherein each element is either 
black or white (zero or one). However, the resulting el- 
ements of the visualizer-coincidence image have values 
ranging between zero and one such that when displayed 
it has various levels of shades of gray. The gray level 
depends on the counter data. 

An embodiment of this alternative scheme is shown 
in Figure 1 5. A visualizer pattern is formed having a pixel 
array equal in size to the element array of the selector, 
1502. The visualizer array consists of white and black 
pixels, where white is given the value one and black the 
value zero. All elements of the selector array will be ex- 
amined to determine the pixel content of the visualizer- 
coincidence image. To do this, the selector element se- 
quence is reset and the first element of the sequence is 
chosen, 1 504. For the chosen selector element, the ratio 
of the count in its corresponding coincidence counter to 
the sum of the counts in its corresponding coincidence 
and non-coincidence counters is computed, 1506. The 
colour of the corresponding visualizer pixel is tested, 
1508, and if it is black, the ratio subtracted from one is 
placed into the corresponding pixel of the visualizer-co- 
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incidence image, 1510a. If the visualizer pixel is white, 
the ratio is placed unmodified into the corresponding 
pixel of the visualizer-coincidence image, 1510b. The 
selector element sequence is tested to see if all ele- 
ments have been chosen. 1512, and if not, the next el- 
ement is chosen, 1514, and steps 1506 to 1512 are re- 
peated. If all selector elements have been chosen, the 
visualizer-coincidence image is displayed as a high con- 
trast monochrome image, 1516. A judgement is made 
as to whether the pattern in the visualizer-coincidence 
image is recognized as a reproduction of the visualizer 
pattern. 1518. If it is recognized, the watermark is pos- 
itively detected, 1520a. If not, the watermark is not de- 
tected, 1520b. 

The following clauses describe various aspects of 
the invention. 

Clause 1 . A method for imparting a watermark onto 
a digitized image comprising the steps of: providing said 
digitized image comprised of a plurality of pixels, where- 
in each of said pixels includes brightness data that rep- 
resents a brightness of at least one colour; and mufti- 
plying said brightness data associated with at least one 
of said pixels by a predetermined brightness multiplying 
factor in the range of 0.9 to 1.1 . 

Clause 2. A method as recited in clause 1 , wherein 
each pixel is associated with a brightness data value 
that represents a brightness of a monochrome colour. 

Clause 3. A method as recited in clause 1 or 2, 
wherein each pixel is associated with a plurality of 
brightness data values. 

Clause 4. A method as recited in clause 3, wherein 
said plurality of brightness data values represents 
brightness of a red, green and blue colour. 

Clause 5. A method as recited in any of the preced- 
ing clauses, wherein said watermark has an invisibility 
classification level of undetectably invisible. 

Clause 6. A method as recited in any of the preced- 
ing clauses, wherein said brightness multiplying factor 
has a relationship with a number taken from a random 
number sequence. 

Clause 7. A method as recited in clause 6, wherein 
said relationship is a linear remapping to provide a de- 
sired modulation strength. 

Clause 8. A method as recited in clause 7, wherein 
said modulation strength is less than 0.5 percent. 

Clause 9. A method as recited in any of clauses 6 
to 8, wherein each of said pixels has a row and a column 
location in an array representing said digitized image, 
and wherein said brightness multiplying factor employs 
a different sequential combination of numbers from said 
random number sequence in sequential correspond- 
ence to said row and column location. 

Clause 1 0. A method as recited in any of the clauses 
6 to 9, wherein said random number sequence is gen- 
erated employing a National Standard Data Encryption 
Algorithm. 

Clause 11 . A method as recited in any of clauses 6 
to 9, wherein said sequence is formed from a plurality 
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of robust watermarking parameters. 

Clause 1 2. A method as recited in clause 1 1 , where- 
in said parameters comprise a cryptographic key, two 
coefficients and an initial value of said random number 
generator. 

Clause 1 3. A method for generating a watermarked 
image wherein a watermark is imparted onto a digitized 
image having a plurality of original elements having orig- 
inal brightnesses, said method comprising the steps of: 
providing a digitized watermarking plane comprising a 
plurality of watermarking elements, having a watermark 
brightness multiplying factor and having one-to-one cor- 
respondence with said original elements; and producing 
a watermarked image by multiplying said original bright- 
ness of each of said original elements by said brightness 
multiplying factor of a corresponding one of said water- 
mark elements wherein said watermark is invisible. 

Clause 14. A method as recited in clause 13, in 
which said brightness multiplying factor is in a range of 
0.9 to 1.1. 

Clause 1 5. A method as recited in clause 1 3 or 14, 
in which said original image forms an original plane and 
said watermarking image forms a watermarking plane 
being smaller than said original plane, said method fur- 
ther comprising the step of extending said watermarking 
plane by tiling such that said watermarking plane at least 
covers said original plane. 

Clause 1 6. A method as recited in clause 1 5, further 
comprising the step of truncating said watermarking 
plane such that said watermarking plane covers said 
original plane, upon determining that said watermarking 
plane extends beyond said original plane. 

Clause 1 7. A method as recited in any of the clauses 
1 3 to 1 6, wherein each of said original elements include 
a plurality of brightness values corresponding to a red, 
a green and a blue colour component. 

Clause 18. A method for forming a watermarking 
plane including a plurality of elements each having a 
brightness multiplying value, said method comprising: 
generating a secure random sequence of integers hav- 
ing a first plurality of bits; linearly remapping said ran- 
dom sequence to form a remapped sequence of bright- 
ness multiplying factors to provide a desired modulation 
strength; computing a discrete Fourier transform of said 
remapped sequence to form a Fourier sequence having 
frequency coordinates; expanding said frequency coor- 
dinates to form an expanded sequence; computing an 
inverse Fourier transform of said expanded sequence 
to obtain a watermarking sequence of values; and de- 
riving said brightness multiplying values of said ele- 
ments of said watermarking plane based upon said wa- 
termarking sequence of values. 

Clause 19. A method as recited in clause 1 8, where- 
in said step of expanding is accomplished by zero-pad- 
ding. 

Clause 20. A method as recited in clauses 1 8 or 1 9, 
wherein said watermarking elements form an array hav- 
ing an array size of 32 by 1 28. 



Clause 21. A method as recited in clauses 18. 19 
or 20 wherein said first plurality of bits is equal to sixteen 
bits and is formed from a second sequence of eight bit 
integers, by selecting abutted pairs of said eight bit in- 
5 tegers. 

Clause 22. A method as recited in any of clauses 
18 to 21 , wherein said modulation strength is 1 percent, 
and said multiplying factors are within a range ranging 
from 0.98 to unity. 
to Clause 23. A method as recited in any of clauses 
18 to 22, further comprising the steps of hardclipping 
said watermarking sequence to form a hardclipped se- 
quence having sequence members, and utilizing a dif- 
ferent one of said sequence members to provide said 
75 multiplying value for each of said elements. 

Clause 24. A method as recited in any of clauses 
18 to 23, further comprising: adjusting said watermark- 
ing sequence to form a linearly remapped sequence of 
values having a mean and a median equal to the differ- 
20 ence between unity and said modulation strength, and 
having a maximum of unity; and employing said linearly 
remapped sequence to provide said multiplying value 
for each of said elements. 

Clause 25. A method as recited in any of clauses 
18 to 24, further comprising: providing an unmarked 
original image having a plurality of original pixels, each 
of said pixels having at least one brightness magnitude, 
wherein a first number of said original pixels is greater 
than a second number of said plurality of elements; ex- 
panding said watermarking plane by tiling to cover said 
unmarked original image such that one of each of said 
pixels has one corresponding element from said ele- 
ments: and multiplying said at least one brightness mag- 
nitude of each of said pixels by said multiplying value of 
said corresponding element. 

Clause 26. A method for detecting a watermark in 
a marked image, wherein said marked image is marked 
by a watermarking plane, said marked image having at 
least one colour plane including a plurality of image pix- 
els, said watermarking plane having a plurality of water- 
marking elements, wherein each of said image pixels 
has at least one brightness value and each of said wa- 
termarking elements has a brightness multiplying factor, 
said method comprising: (a) reconstructing said water- 
marking plane; (b) aligning said watermarking plane 
with said marked image such that each watermarking 
element has a corresponding image pixel; (c) providing 
a selector array and a visualizer image of equal size, 
wherein said selector array has a plurality of selector 
elements each having at least one counter, and wherein 
said visualizer image has a plurality of visualizer pixels 
each having at least one brightness value, and wherein 
said visualizer pixels represent a recognizable pattern 
when displayed; (d) resetting said at least one counter 
to zero; (e) placing said selector in an initial position by 
aligning said selector elements with a plurality of corre- 
sponding image pixels and a plurality of corresponding 
watermarking elements; (f ) choosing a selector element 
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and identifying a corresponding watermarking element; 
(g) identifying a first plurality of watermarking elements 
that neighbour said corresponding watermarking ele- 
ment; (h) generating a first average that represents an 
average of brightness multiplying factors of said first plu- s 
rality of watermarking elements; (i) choosing a colour 
plane of said marked image and finding a corresponding 
image pixel; (j) identifying a first plurality of neighbouring 
pixels that neighbour said corresponding image pixel; 
(k) generating a second average that represents an av- 10 
erage of brightness values of said first plurality of neigh- 
bouring pixels; (1) updating said at least one counter 
based upon first and second comparison operations, 
wherein said first comparison operation compares said 
first average with said brightness multiplying factor of is 
said corresponding watermarking element and said sec- 
ond comparison operation compares said second aver- 
age with said brightness value of said corresponding 
pixel; (m) repeating steps (i) through (1) for all colour 
planes; (n) repeating steps (f) through (m) for all selector 20 
elements; (o) choosing a new selector position that does 
not overlap any previous selector position; (p) repeating 
steps (f) through (o) for all non-overlapping selector po- 
sitions; and (q) generating a visual representation indi- 
cating detection of said watermark in said marked image 25 
utilizing said at least one counter of said selector array 
and said visualizer pixels. 

Clause 27. The method as recited in clause 26, 
wherein said at least one counter includes a coincidence 
counter and a non-coincidence counter and wherein 30 
said updating step includes the steps of: generating a 
first difference value by subtracting said first average 
from said brightness multiplying factor of said corre- 
sponding watermarking element; generating a second 
difference value by subtracting said second average 3S 
from said brightness value of said corresponding pixel; 
and incrementing said coincidence counter if said first 
and second difference values are both positive, and in- 
crementing said coincidence counter if said first and 
second difference values are both negative, otherwise, 40 
incrementing said non -coincidence counter. 

Clause 28. A method as recited in clause 26 or 27, 
wherein said placing step is performed using random 
vertical and horizontal offsets. 

Clause 29. A method as recited in clause 28, where- 45 
in said offsets are derived from a secure random se- 
quence. 

Clause 30. A method as recited in clauses 26, 27, 
28 or 29 wherein said first plurality is a number equal to 
120. so 

Clause 31. A method as recited in any of clauses 
26 to 30 : wherein each pixel of said visualizer image has 
a monochrome brightness value. 

Clause 32. A method as recited in any of clauses 
26 to 31 . wherein each pixel of said visualizer image has ss 
a plurality of brightness values. 

Clause 33. A method as recited in clause 32, where- 
in each pixel of said visualizer image has a red, green 



and blue brightness value. 

Clause 34. A method as recited in claim 26, wherein 
generating step (q) includes the step of building a visu- 
alizer coincidence image having a plurality of coinci- 
dence pixels that have one-to-one correspondence with 
said visualizer and said elements of said selector array, 
and which includes for each given coincidence pixel the 
steps of: identifying a first element of said selector array 
that corresponds to said given coincidence pixel; gen- 
erating a coincidence value based upon a value stored 
in said at least one counter associated with said first el- 
ement of said selector array; identifying a first pixel of 
said visualizer image that corresponds to said given co- 
incidence pixel; generating at least one brightness value 
for said given coincidence pixel based upon said coin- 
cidence value and at least one brightness value of said 
first pixel of said visualizer image. 

Clause 35. A method as recited in clause 34, further 
comprises the step of displaying said visualizer coinci- 
dence image such that a user can make a determination 
as to whether said pattern encoded by said visualizer 
pixels is recognizable. 

Clause 36. A method as recited in clause 34 or 35, 
wherein said at least one counter includes a coincidence 
counter and a non-coincidence counter, and wherein 
said updating step includes the steps of: generating a 
first difference value by subtracting said first average 
from said brightness multiplying factor of said corre- 
sponding watermarking element; generating a second 
difference value by subtracting said second average 
from said brightness value of said corresponding image 
pixel: and incrementing said coincidence counter if said 
first and second difference values are both positive, and 
incrementing said coincidence counter if said first and 
second difference values are both negative, otherwise, 
incrementing said non-coincidence counter. 

Clause 37. A method as recited in clause 36, where- 
in said step of generating said coincidence value in- 
cludes the step of generating a third difference value by 
subtracting said non-coincidence counter from said co- 
incidence counter, and generating said at least one 
brightness value of said given coincidence pixel by mod- 
ifying said at least one brightness value of said first vis- 
ualizer pixel if said third difference is negative, and by 
copying said brightness value of said first pixel of said 
visualizer image otherwise. 

Clause 38. The method as recited in clause 37, 
wherein each visualizer pixel has a monochrome bright- 
ness value, and wherein said modifying step comprises 
the step of inverting said monochrome brightness value 
associated with said first pixel of said visualizer image. 

Clause 39. The method as recited in clause 36, 37 
or 38, wherein each visualizer pixel has a binary mono- 
chrome brightness value, said binary monochrome 
brightness value being one of a first value representing 
a black brightness and a second value representing a 
white brightness; wherein said step of generating said 
coincidence value includes the step of generating a ratio 
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R, wherein R represents said coincidence counter divid- 
ed by a sum of said coincidence counter and said non- 
coincidence counter: and wherein said step of generat- 
ing said at least one brightness value of said given co- 
incidence pixel includes the steps of: assigning said at 
least one brightness value of said given coincidence pix- 
el to a value (1 -R) if said binary monochrome brightness 
value of said first pixel is set to said first value, and as- 
signing said at least one brightness value of said given 
coincidence pixel to said ratio R if said binary mono- 
chrome brightness value of said first pixel is set to said 
second value. 

Clause 40. A method as recited in any of clauses 
34 to 39, further comprising the step of displaying said 
visualizer coincidence image such that a user can make 
a determination as to whether said watermark is detect- 
ed. 

In summary, a robust means of watermarking a dig- 
itized image with a highly random sequence of pixel 
brightness multipliers is presented. The random se- 
quence is formed from 'robust- watermarking -parame- 
ters' selected and known only by the marker and/or the 
marking entity. A watermarking plane is generated 
which has an element array with one-to-one element 
correspondence to the pixels of the digitized image be- 
ing marked. Each element of the watermarking plane is 
assigned a random value dependent upon a robust ran- 
dom sequence and a specified brightness modulation 
strength. The so generated watermarking plane is im- 
parted onto the digitized image by multiplying the bright- 
ness value or values of each pixel by its corresponding 
element value in the watermarking plane. The resulting 
modified brightness values impart the random and rel- 
atively invisible watermark onto the digitized image. 
Brightness alteration is the essence of watermark im- 
parting. Detection of an imparted watermark requires 
knowing the watermarking plane with which the water- 
mark was imparted. Regeneration of the watermarking 
plane requires knowledge of the robust-marking-param- 
eters used in its formulation. This is generally only 
known to the marker and/or marking entity. Once regen- 
erated the watermarking plane is used together with a 
verifying image located in a Visualizer 1 to demonstrate 
the existence of the watermark. 

Although the description is made for particular em- 
bodiments, techniques and arrangements, the intent 
and concept of the present invention are suitable to oth- 
er embodiments, techniques and arrangements. For ex- 
ample, an obvious choice, and the choice of last resort, 
in demonstrating the existence of a watermark in a ma- 
nipulated marked image is to again impart the water- 
mark onto a copy of the unmarked original digitized im- 
age, and to use the colour planes of that reconstituted 
marked image as ideal substitutes for the watermarking 
plane. The disadvantage of this alternative method is 
that it requires access to a copy of the unmarked original 
image. The visualizer can also have multiple colour 
planes. The visualizer can be employed without the se- 



lector by having at least one statistical value associated 
with each pixel of the visualizer. Also, sequential repo- 
sitioning of the selector on the reconstituted watermark- 
ing plane need not be non-overlapping. Non-overlap- 

5 ping selector positions in the presented embodiment 
represent only a computational simplification. Also, a 
small random but coherent image may be included in 
the watermarking plane at positions known only to the 
marker and/or marking entity; if the so constituted wa- 

*o termarking plane were imparted onto a uniform colour 
plane with strong modulation strength, the coherent im- 
age would be visible without use of a visualizer. Other 
methods of watermark detection and/or demonstration 
may be employed. These may for instance utilize any of 

'5 the many statistical relationships between elements and 
their neighbours or non-neighbours. The robust tech- 
niques presented here may be used in combination with 
visible watermarking techniques as well as fragile invis- 
ible techniques. It will be clear to those skilled in the art 

20 that other modifications to the disclosed embodiments 
can be effected without departing from the spirit and 
scope of the invention. 

25 Claims 

1 . A method for imparting a watermark onto a digitized 
image comprising the steps of: 

30 providing said digitized image comprised of a 

plurality of pixels, wherein each of said pixels 
includes brightness data that represents a 
brightness of at least one colour; and 

35 multiplying said brightness data associated 

with at least one of said pixels by a predeter- 
mined brightness multiplying factor in the range 
of 0.9 to 1.1. 

4 o 2. A method as recited in claim 1, wherein each pixel 
is associated with at least one brightness data val- 
ue. 

3. A method as recited in any of the preceding claims, 
45 wherein said watermark has an invisibility classifi- 
cation level of undetectably invisible. 

4. A method as recited in any of the preceding claims, 
wherein said brightness multiplying factor has a re- 

50 lat ion ship with a number taken from a random 
number sequence. 

5. A method as recited in claim 4, wherein said rela- 
tionship is a linear remapping to provide a desired 

55 modulation strength. 

6. A method for generating a watermarked image 
wherein a watermark is imparted onto a digitized im- 
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age having a plurality of original elements having 
original brightnesses, said method comprising the 
steps of: 

providing a digitized watermarking plane com- s 
prising a plurality of watermarking elements, 
having a watermark brightness multiplying fac- 
tor and having one-to-one correspondence with 
said original elements; and 

w 

producing a watermarked image by multiplying 
said original brightness of each of said original 
elements by said brightness multiplying factor 
of a corresponding one of said watermark ele- 
ments wherein said watermark is invisible. is 



A2 34 

providing an unmarked original image having a 
plurality of original pixels, each of said pixels 
having at least one brightness magnitude, 
wherein a first number of said original pixels is 
greater than a second number of said plurality 
of elements; 

expanding said watermarking plane by tiling to 
cover said unmarked original image such that 
one of each of said pixels has one correspond- 
ing element from said elements; and 

multiplying said at least one brightness magni- 
tude of each of said pixels by said multiplying 
value of said corresponding element. 



7. A method for forming a watermarking plane includ- 
ing a plurality of elements each having a brightness 
multiplying value, said method comprising; 

generating a secure random sequence of inte- 
gers having a first plurality of bits; 

linearly remapping said random sequence to 
form a remapped sequence of brightness mul- 
tiplying factors to provide a desired modulation 
strength; 

computing a discrete Fourier transform of said 
remapped sequence to form a Fourier se- 
quence having frequency coordinates; 

expanding said frequency coordinates to form 
an expanded sequence; 

computing an inverse Fourier transform of said 
expanded sequence to obtain a watermarking 
sequence of values; and 

deriving said brightness multiplying values of 
said elements of said watermarking plane 
based upon said watermarking sequence of 
values. 

8. A method as recited in claim 7, further comprising: 

adjusting said watermarking sequence to form 
a linearly remapped sequence of values having 
a mean and a median equal to the difference 
between unity and said modulation strength, 
and having a maximum of unity; and 

employing said linearly remapped sequence to 
provide said multiplying value of each of said 
elements. 

9. A method as recited in claim 7, further comprising: 



10. A method for detecting a watermark in a marked im- 
age, wherein said marked image is marked by a wa- 
termarking plane, said marked image having at 
least one colour plane including a plurality of image 
pixels, said watermarking plane having a plurality 
of watermarking elements, wherein each of said im- 
age pixels has at least one brightness value and 
each of said watermarking elements has a bright- 
ness multiplying factor, said method comprising: 

(a) reconstructing said watermarking plane; 

(b) aligning said watermarking plane with said 
marked image such that each watermarking el- 
ement has a corresponding image pixel; 

(c) providing a selector array and a visualizer 
image of equal size, wherein said selector array 
has a plurality of selector elements each having 
at least one counter, and wherein said visualiz- 
er image has a plurality of visualizer pixels each 
having at least one brightness value, and 
wherein said visualizer pixels represent a rec- 
ognizable pattern when displayed; 

(d) resetting said at least one counter to zero; 

(e) placing said selector in an initial position by 
aligning said selector elements with a plurality 
of corresponding image pixels and a plurality of 
corresponding watermarking elements; 

(f ) choosing a selector element and identifying 
a corresponding watermarking element; 

(g) identifying a first plurality of watermarking 
elements that neighbour said corresponding 
watermarking element; 

(h) generating a first average that represents 
an average of brightness multiplying factors of 
said first plurality of watermarking elements; 
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(i) choosing a colour plane of said marked im- 
age and finding a corresponding image pixel; 

(j) identifying a first plurality of neighbouring 
pixels that neighbour said corresponding image s 
pixel; 

(k) generating a second average that repre- 
sents an average of brightness values of said 
first plurality of neighbouring pixels; w 

(I) updating said at least one counter based up- 
on first and second comparison operations, 
wherein said first comparison operation com- 
pares said first average with said brightness 
multiplying factor of said corresponding water- 
marking element and said second comparison 
operation compares said second average with 
said brightness value of said corresponding 
pixel; 

(m) repeating steps (i) through (1 ) for all colour 
planes; 

(n) repeating steps (f) through (m) for all selec- 2S 
tor elements; 

(o) choosing a new selector position that does 
not overlap any previous selector position; 

30 

(p) repeating steps (f) through (o) for all non- 
overlapping selector positions; and 

(q) generating a visual representation indicat- 
ing detection of said watermark in said marked 35 
image utilizing said at least one counter of said 
selector array and said visualizer pixels. 
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REGENERATE AN EXACT COPY OF THE 
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PARAMETERS 
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ARRAYS OF EQUAL SIZE, (e.g. 32x128). 



-702 



SET SELECTOR'S COINCIDENCE AND 
NON-COINCIDENCE COUNTERS TO ZEROS 



704 



INITIALLY PLACE SELECTOR ON THE MARKED IMAGE AND 
WATERMARKING PLANE, ALIGNING UPPER-LEFT CORNERS 



-706 





^7 

f 


SCALE THE TWO INTEGERS TO FORM RANDOM HORIZONTAL AND VERTICAL 
OFFSETS FROM PRESENT SELECTOR LOCATION AND MOVE THE SELECTOR THERE 




f 



708 



-710 
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(54) Protecting images with an image watermark 



(57) A robust means of watermarking a digitized im- 
age with a highly random sequence of pixel brightness 
multipliers is presented. The random sequence is 
formed from 'robust-watermarking-parameters' select- 
ed and known only by the marker and/or the marking 
entity. A watermarking plane is generated which has an 
element array with one-to-one element correspondence 
to the pixels of the digitized image being marked. Each 
element of the watermarking plane is assigned a ran- 
dom value dependent upon a robust random sequence 
and a specified brightness modulation strength. The so 
generated watermarking plane is imparted onto the dig- 
itized image by multiplying the brightness value or val- 



ues of each pixel by its corresponding element value in 
the watermarking plane. The resulting modified bright- 
ness values impart the random and relatively invisible 
watermark onto the digitized image. Brightness altera- 
tion is the essence of watermark imparting. Detection of 
an imparted watermark requires knowing the water- 
marking plane with which the watermark was imparted. 
Regeneration of the watermarking plane requires 
knowledge of the robust-marking-parameters used in its 
formulation. This is generally only known to the marker 
and/or marking entity. Once regenerated the water- 
marking plane is used together with a verifying image 
located in a Visual izer' to demonstrate the existence of 
the watermark. 
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